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Description 



METHOD FOR IMAGE PROCESSING BY 

UNSHARP MASKING 

Background of Invention 
[000 1 ] 1. Field of the Invention 

[0002] The present invention relates to a method for adjusting an 

image signal by a processor, and more specifically, to a 
method for image processing by unsharp masking. 

[0003] 2. Description of the Prior Art 

[0004] please refer to Fig.l and Fig. 2. Fig.l is a block diagram il- 
lustrating a conventional image processing system 10 and 
Fig. 2 illustrates an image 14 of the image processing sys- 
tem 10 in Fig.l. The image processing system 10 includes 
a memory 12 for storing programs and the image 14 to be 
processed, and a processor 16 for executing the pro- 
grams stored in the memory 12. The image 14 includes a 
plurality of pixels 18 arranged in matrix form. The image 
14 is composed of an image area 20 with specific features 



and a boundary area 22 around the image area 20. 

[0005] a goal of image processing is to have the features of the 

image area 20 stand out while keeping the image area 20 
and the surrounding edge area 22 in harmony. An adjust- 
ment of the image parameters of the whole image 14 will 
sacrifice some features that are not within the image area 
20 or cause distortion of the image area 20. For this rea- 
son, some image processing methods adjust only the im- 
age parameters of the surrounding edge area 22 in order 
to emphasize the high frequency characteristic of the 
edge of the image. 

[0006] jhe unsharp mask method is a method based on the con- 
cept mentioned above. According to the method, first un- 
sharpen an image to obtain a low frequency element of 
the image, then subtract the unsharpened image from the 
original image to obtain a high frequency element of the 
original image.Apply a convolution operation to the re- 
maining high frequency image and eventually add the 
subtracted low frequency image to the remaining high 
frequency image to complete the process. Although the 
unshap mask method can sharpen the edge of the image, 
it also increases the high frequency element of the image 
and raises the luminance of the whole image, making it 



lighter. In addition, according to the conventional unsharp 

mask method, while applying the convolution operation to 

the high frequency image and adding back the subtracted 

low frequency image, because two operation intensive 

calculations are required to be processed simultaneously, 

processing time and image processing cost are increased. 
Summary of Invention 

[0007] K j S therefore a primary objective of the present invention 
to provide a method for adjusting an image signal by a 
processor to solve the problem mentioned above. 

[0008] Briefly summarized, a method for adjusting an image sig- 
nal by a processor includes providing a first low pass filter 
and a second low pass filter; generating an energy ratio of 
a band-pass image signal and the image signal according 
to the standard deviation of the low pass signal of the first 
low pass filter and the low pass signal of the second low 
pass filter; providing an image adjustment parameter and 
generating a weighting coefficient of the image signal ac- 
cording to the energy ratio and the image adjustment pa- 
rameter; generating a third low pass filter according to the 
weighting coefficient of the image signal, the image ad- 
justment parameter, the low pass signal of the first low 
pass filter, and the low pass signal of the second low pass 



filter; and adjusting the image signal according to the im- 
age signal and the third low pass filter. 
[0009] These and other objectives of the present invention will no 
doubt become obvious to those of ordinary skill in the art 
after reading the following detailed description of the pre- 
ferred embodiment that is illustrated in the various fig- 
ures and drawings. 
Brief Description of Drawings 

[0010] Fig.l is a block diagram illustrating a conventional image 

processing system. 
[0011] Fig. 2 illustrates an image of the image processing system 

in Fig.l. 

[0012] pig. 3 is a block diagram illustrating an image processing 
system according to the present invention. 

[0013] Fig. 4 illustrates a flowchart of image processing by the 

image processing system according to the present inven- 
tion. 

[0014] Fig. 5 illustrates a subtraction between a low pass filter 
signal 




of the first low pass filter and a low pass filter signal 



of the second low pass filter in frequency domain. 

[0015] Fig. 6 illustrates a flowchart for image processing by an 

image processing system according to the second embod- 
iment of the present invention. 

[0016] Fig. 7 illustrates a subtraction between the unit pulse sig- 
nal 



of the second low pass filter in frequency domain. 
Detailed Description 

[0017] please refer to Fig. 3. Fig. 3 is a block diagram illustrating 
an image processing system 30 according to the present 
invention. The image processing system 30 includes a 
memory 32 for storing an image processing program 34 
and an image 36 to be processed. The image processing 
program 34 includes a first low pass filter 38 and a sec- 
ond low pass filter 40 implemented using software. The 




and a low pass filter signal 




first low pass filter 38 and the second low pass filter 40 
can also be hardware circuits. The image processing sys- 
tem 30 further includes an image processor 42 for exe- 
cuting the image processing program 34 stored in the 
memory 32, and an input device 44 for image parameter 
settings. 

[0018] please refer to Fig. 4 showing a flowchart for image pro- 
cessing by the image processing system 30 according to 
the present invention. The flowchartin Fig. 4 includes fol- 
lowing steps: 

[0019] step 100:Please refer to Fig. 5 showing a subtraction be- 
tween a low pass filter signal 



of the first low pass filter 38 and a low pass filter signal 



of the second low pass filter 40, shown in frequency do- 
main. Obtain a band-pass filter signal 






by subtracting the low pass filter signal 



of the second low pass filter 40 from the low pass filter 
signal 

*i i x > y) 

of the first low pass filter 38. Define the signal result- 
ingfrom convolutingthe band-pass filter signal 

and an image signal 

fay) 

as a band-pass image signal 

h{x,y)®l{x,y) 

, wherein ® means convolution. 
[0020] step 102:Generate an energy ratio 




of the band-pass image signal and the image signal ac- 
cording to the standard deviation of the low pass filter 
signal 

h \ (*. y) 

of the first low pass filter 38 and the low pass filter signal 
of the second low pass filter 40. The energy ratio 



of the band-pass image signal 
and the image signal 

i (*. y) 

is equivalent to 




wherein 




is not equivalent to 



#2 



[0021] st e p i04:Provide a maximum image distortion ratio and 
divide it with theenergy ratio 




to obtain a maximum image adjustmentweightingcoeffi- 
cient 



max 



. Further provide an image adjustment normalized value 
between 0 and 1 so that an image adjustment parameter 
C can be obtained by multiplying the maximum image 
adjustment weighting coefficient 



max 



with the image adjustment normalized value. A user can 
input the image adjustment normalized value by the input 
device 44 of the image processing system 30 to obtain 
the image adjustment parameter C . 
[0022] st e p i06:Generate a weighting coefficient C i of the image 
signal according to the energy ratio 




and the image adjustment parameter C , wherein 



B 



[0023] step 108:Obtain a third low pass filte 



according to the weighting coefficient C of the image 
signal, the image adjustment parameter C , the low pass 
filter signal 

of the first low pass filter 38, and the low pass filter signal 
of the second low pass filter 40, wherein 



, and 

s{x. y) 

is a delta function. 
[0024] st e p nominally, convolute the third low pass filter 41 



with the image signal 

fay) 

to obtain an adjusted image signal 



A{x,y)=k 2 {x,y)®l{x,y) 



, wherein ® means convolution. 
[0025] The image processing method according to the first em- 
bodiment of the present invention includes capturing the 
high frequency portion of the image 36 and applying a 
convolution operation, i.e. 



C 2 [k(x,y)®l(x,y)] 



.Then adding the weighting coefficient of the original sig- 
nal, i.e. 



, so that the high frequency portion can be emphasized. 
Further imposing a restriction according to conservation 
of energy, i.e. 



(E fi - C l B ! + C 2 B^j)^ [E fi - Ej) 



, and calculating an adjusted image signal 



under the condition that the energy of the adjusted image 
signal 



is equivalent to the energy of the original image signal 

■ 

[0026] More specifically, under the condition that a limited signal 

has the same energy in either time domain and space do- 
main according to the Rayleigh"s theorem, calculate the 
energy ratio 



of the band-pass image signal 
and the image signal 

i (*. y) 

, wherein 




J 




and 



represent respectively the standard deviations of the low 
pass filter signal 

h \ (*. y) 

of the first low pass filter 38 and the low pass filter signal 
of the second low pass filter 40, and 




is not equivalent to 




so that 




will not be zero and the band-pass filter signal 

can capture the high frequency portion of the image 36. 
Then obtain 



B 



on the basesthat 



[0027] Subsequently, while determining the image adjustment 

parameter C and the weighting coefficient C of the image 
signal in Step 104 and Step 106, a maximum image dis- 
tortion ratio must first be determined, that is the maxi- 
mum acceptable energy decay of the unprocessed low fre- 
quency portion such as the image area 20 in Fig. 2. For in- 
stance, if the energy decay of the image area of the image 
36 is to be limited to 5%, the minimum weighting coeffi- 
cient of the image signal can be determined as 



C lffiil = 1-0.05 = 0.95 



and the maximum image adjustment weighting coefficient 
can be determined as 



a 



0.05 



man 



. For the user"s convenience, it is possible to provide the 
image adjustment normalized value between 0 and 1 nor- 
malized from the image adjustment parameter C by the 
input device 44 of the image processing system 30 so that 
the image adjustment parameter C can be obtained by 
multiplying the maximum image adjustment weighting 
coefficient 



max 



with the image adjustment normalized value. That is, 
when a user inputs 1 as the normalized value by the input 
device 44, the image adjustment parameter C is 



a 



0.05 



man 



, the weighting coefficient C^of the image signal is 0.95, 
and the adjusted energy amplitude will be 5% in maxi- 
mum. Alternatively, when the user inputsO as a corre- 
sponding weighting coefficient by the input device 44, the 
image adjustment parameter C is 0, the weighting coeffi- 
cient C of the image signal is 1, and the adjusted energy 
amplitude will be 0% in minimum, which means not to ad- 
just the image 36. 
[0028] Continuously evaluate the third low pass filter 41 



the first filter 38, the second filter 40, the above- 
mentioned C and C , and the equation 



htfay) = C l S(x,y) + C 2 [h l (x,y)-k 2 (x,y)] 



, wherein 

s{x. y) 

is a unit pulse signal. Convolute the third low pass filter 
41 and the image signal to obtain the adjusted image sig- 
nal 



. In such a way the luminance change in the prior art can 
be improved. 

[0029] please refer to Fig. 6 showing a flowchart for image pro- 
cessing by an image processing system 30 according to 
the second embodiment of the present invention. The dif- 
ference between the two embodiments is that in the sec- 
ond embodiment, to simplify the calculation, a second low 
pass filter 40 and a unit pulse signal are used instead of 
the first low pass filter 38. However, when inputting an 
image adjustment value, the second embodiment will not 
show a linear transition as in the first embodiment. The 
flowchart in Fig. 6 includes following steps: 



[0030] step 112:Please refer to Fig. 7 showing a subtraction be- 
tween the unit pulse signal 

si*, y) 

and a low pass filter signal 

of the second low pass filter 40 in frequency domain. De- 
termine a high pass filter signal 

h'{x,y) 



obtained by subtracting the low pass filter signal 



of the second low pass filter 40 fromthe low pass filter 
signal 

of the first low pass filter 38. Define the signal resulted by 
convoluting 



and an image signal 

fay) 



as a high pass image signal 



[0031] step 114:Generate an energy ratio 



of the high pass image signal and the image signal ac- 
cording to the standard deviation of the low pass filter 
signal 

of the second low pass filter 40. The energy ratio 




of the high pass image signal 



h'{x,y)®l{x,y) 



and the image signal 

i (*. y) 

is equivalent to 



1_ 2 

Axa 2 



, wherein 




is larger than 




[0032] st e p ii6:Provide a maximum image distortion ratio and 
divide it with the energy ratio 




to obtain a maximum image adjustment weighting coeffi- 
cient 



max 



. Further provide an image adjustment normalized value 
between 0 and 1 so that an image adjustment parameter 
C can be obtained by multiplying the maximum image 
adjustment weighting coefficient 



max 



with the image adjustment normalized value. A user can 
input the image adjustment normalized value using an in- 
put device 44 of the image processing system 30 to ob- 
tain the image adjustment parameter C . 

4 

[0033] step 118:Generate a weighting coefficient C of the image 
signal according to the energy ratio 




and the image adjustment parameter wherein 



C 3 =l-C + 



E 



[0034] st e p i20:Obtain a fourth low pass filter 




according to the weighting coefficient C of the image sig- 
nal, the image adjustment parameter C , and the low pass 
filter signal 

of the second low pass filter 40, wherein 



h, (x,y) = C,S{x,y) + C 4 [<5(x, y) - k 2 (x. y)] 



and 

S (*, y) 

is the unit pulse signal. 
[0035] step 122:Convolute the third lowpass filter 46 




and the image signal 

fay) 

to obtain an adjusted image signal 



[0036] jhe image processing method according to the second 
embodiment is essentially the same to that of the first 
embodiment.The method is to capture the high frequency 
portion of the image 36 and apply a convolution opera- 
tion, i.e. 




, then add the weighting coefficient of the original signal, 
i.e. 



, so that the high frequency portion is emphasized. Addi- 
tionally, impose a restriction according to the conserva- 
tion of energy, i.e. 



, and calculate an adjusted image signal 



/ a (x- y) 



under the condition that the energy of the adjusted image 
signal 



/ a (x- y) 



is equivalent to the energy of the original image signal 

■ 

[0037] | n t ne same manner, under the condition that a limited 
energy signal has the same energy in either time domain 
or space domain according to the Rayleigh"s theorem, 
calculate the energy ratio 




of the high pass image signal 



h'{x,y)®l{x,y) 



and the image signal 

i (*. y) 

, wherein 




, and 




is larger than 




so that 




will be larger than zero, in other words, the band-pass fil- 
ter signal 



h'{x,y)®l{x,y) 



is able to capture the high frequency portion of the image 
36. Since the flowchart of the second embodiment is simi- 
lar to that of the first embodiment, further description is 
hereby omitted. 

[0038] | n contrast to the prior art, the present invention is capa- 
ble of sharpening the edge of an image while maintaining 
the luminance, so that the disadvantage of the prior art 
which makes the image lighter due to the increased high 
frequency portion can be improved. Additionally, in con- 
trast to the operation intensive calculations caused by 
twice adjustments on image signals required by the prior 
art, the method according to the present invention only 



calculates weighted parameters and filter signals in space 
domain first. In such a manner the operationsare reduced 
and, accordingly, the cost and time of image processing is 
reduced at the same time. 
[0039] Those skilled in the art will readily observe that numerous 

modifications and alterations of the device may be made 
while retaining the teachings of the invention. Accord- 
ingly, the above disclosure should be construed as limited 
only by the metes and bounds of the appended claims. 



